IMAGE EDGE EXTRACTION VIA FUZZY REASONING 
CROSS REFERENCE TO RELATED APPLICATIONS 

[0001] This application is related to an application entitled Optimal Binarization of 
Gray-Scaled Images Via Fuzzy Reasoning, which is commonly owned with the subject 
5 application and is to be filed under Docket Number KSC-12490. 
ORIGIN OF THE INVENTION 

[0002] The invention described herein was made in the performance of work 
under a NASA contract and is subject to the provisions of Public Law 96-517 (35 U.S.C. 
§202) in which the contractor has elected not to retain title. 

10 BACKGROUND OF THE INVENTION 
1 . Field of the Invention 
[0003] The present invention relates in general to a method and system for 
detecting edges in digital images in which fuzzy reasoning is employed to determine the 
degree to which each pixel in an image represents an edge. 

15 2. Description of the Background Art 

[0004] Accurate detection in images of edges, which contain the most important 
information, is vital to performing advanced image processing and analysis. 
Unfortunately, images of real scenes frequently contain data that is ambiguous and 
incomplete. As a result, the problem of determining what is and what is not an edge is 

20 confounded by the fact that edges are very often partially hidden or distorted by various 
effects such as uneven lighting and image acquisition noise. Furthermore, images 
frequently contain data with edge-like characteristics, but a confident classification of 
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this data can be best solved when high-level constraints are imposed on the 
interpretation of an image. 

[0005] Most known edge detector techniques require the selection of parameters 
(e.g. thresholds in gradient edge detectors, thresholds in Laplacian edge detectors, and 

5 s in Laplacian of Gaussian edge detectors) when no information about the images is 
known in advance. Edge detection based on mathematical models can only detect 
specific kinds of noticeable edges. For example, an optimal mathematical-model-based 
step edge detector can be ineffective for ramp edges. Moreover, the parameters in 
some of the mathematical models are difficult to determine when little information about 

10 the image is known. 

[0006] Human beings, on the other hand, are able to make some sense of even 
unfamiliar objects, which necessarily have an imperfect high-level representation. To 
perceive unfamiliar objects, or to perceive familiar objects with imperfect images, it 
appears that humans apply heuristic algorithms to understand such images. Although 

15 these algorithms may be "implemented" in the wetware of the human vision system, it is 
feasible to believe that it is possible to characterize an equivalent process 
systematically. One would therefore suspect that a system that employs human like 
heuristic algorithms would be particularly suited for image edge detection considering 
the indeterminate nature of edge detection data. Such a system may well be found to 

20 out perform other, mathematical based edge detection techniques. 
SUMMARY OF THE INVENTION 

[0007] The present invention provides such a heuristic algorithm based technique 
for image edge detection that has in fact been shown to outperform previous 
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mathematical based edge detection techniques. More particularly, the technique 
employs fuzzy reasoning, which is a suitable framework for expressing heuristic 
processes applied to incomplete and imperfect image data. With fuzzy reasoning, the 
edge detection technique is completely adaptive with no need for selecting parameters. 
5 The use of fuzzy reasoning with the power to model and respond usefully to 

approximate situations is ideally suited to edge detection because the nature of the data 
is indeterminate at a low-level stage of processing. 

[0008] In the specific method of the present invention, a multiple pixel digital 
image is analyzed for edges on a pixel-by-pixel basis. That is, each pixel in the image 

10 is analyzed to determine the degree to which it represents a part of an edge in the 
image. The analysis relies on the fact that if a pixel is on an edge, then that edge will 
extend in some direction away from the pixel and pixels on either side of the edge will 
likely have gray values that differ substantially from one another. For example, if 
predominantly dark, low valued pixels are on one side of the edge, predominantly light 

15 or high valued pixels will likely be on the opposite side of the edge. 

[0009] With the foregoing in mind, the method of the present invention begins 
edge analysis of a pixel in the image by identifying an edge path running through the 
pixel and determining the intensity gradient on either side of the edge. To do this, a 
square n x n pixel window (n being an odd number greater or equal to 3) is preferably 

20 used with the pixel to be analyzed being located at the center of the window. There are 
four possible edge paths through the center pixel: horizontal, vertical and two 45 degree 
diagonals. Each one of these edge paths splits the n x n pixel window into two regions, 
each holding an equal number of pixels. 
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[001 0] In the preferred embodiment, the average change of gray levels across 
each one of the four edge paths is computed and the edge path with the greatest 
change of gray levels is chosen to be used as a dimensionless input to a fuzzy 
membership function. The linguistic values (or labels) used for the average change of 

5 gray levels are those one heuristically might use: Small, Medium and Large. The output 
variable is the degree of edginess that the central pixel in the window has based on the 
intensity gradient value and is preferably evaluated using a known inference method 
referred to as the Truth Value Flow Inference (TVFI) method that uses singletons 
instead of fuzzy sets as used in the widely-used Mandini method. The linguistic 

10 variables (or labels) of the output value are also those one heuristically might use: 
Edge, Mild edge and No Edge. Simple inference rules are then used to express the 
dependency between the input and output values. If the grayness change is small, then 
the central pixel is No Edge; if the grayness change is Medium, then the central pixel is 
a Mild Edge; and, if the grayness change is Large, then the central pixel is Edge. A 

15 value between 0.0 and 1 .0 is thus assigned to each of these three characteristics, which 
values represent the degree to which the pixel is an Edge, a Mild Edge or No Edge. 
[001 1] The final step of the method is defuzzification where the three 
characteristic output values for the selected edge path are combined using an 
averaging method to determine the crisp output value for the central pixel. Preferably, 

20 the averaging method is either an averaging union of truncated output singletons (TVFI 
method) or a centroid averaging process (Mandini method). The final output value of 
the central pixel is generated by multiplying the full grayness level and its respective 
edginess degree, which results in assignment of a new gray level value to the pixel that 
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is directly proportional to the pixel's edginess degree. The foregoing process is then 

repeated for all other possible windows until each pixel in the image has been 

characterized based on edginess. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 [0012] The features and advantages of the present invention will become 

apparent from the following detailed description of a preferred embodiment thereof, 

taken in conjunction with the accompanying drawings, in which: 

[0013] FIG. 1 is a block diagram of a computer system that can be employed for 

detecting edges in digital images using a fuzzy reasoning based algorithm in 
10 accordance with the preferred embodiment of the present invention; 

[0014] FIG. 2 is a flowchart showing the steps carried out by the edge detection 

algorithm of the preferred embodiment; 

[0015] FIG. 3 is a schematic illustration of a 3 x 3 pixel window that is employed 
in the edge detection algorithm of the preferred embodiment to identify an edge passing 
15 through a pixel in an image having a maximum intensity gradient from one side of the 
edge to the opposite side of the edge; 

[0016] FIG. 4 is graph illustrating an input fuzzy membership function employed 
in the edge detection algorithm of the preferred embodiment; 
[0017] FIG. 5 is a graph illustrating an output fuzzy membership function that is 
20 employed in the edge detection algorithm of the preferred embodiment; 

[0018] FIG. 6 is a graph illustrating how an input value is employed by the input 
membership function to determine the singleton values (TVFI method) on the respective 
output membership value; 
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[0019] FIG. 7 is a graph illustrating how the final crisp output value is generated 
based on the singleton output values shown in FIG. 6; 

[0020] FIG. 8 is a gray-scale image to be analyzed for edges in accordance with 
the preferred embodiment; 
5 [0021] FIG. 9 is an output from a first prior art edge detector algorithm of the 
image of FIG. 8; 

[0022] FIG. 1 0 is an output from a second prior art edge detector algorithm of the 
image of FIG. 8; and 

[0023] FIG. 11 is an output from the edge detector algorithm of the preferred 

10 embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0024] With reference to FIG. 1 , a computer system 1 0 is illustrated which 
includes a processor 12 that is interfaced to an operating memory 14 and a storage 
memory 16, as is conventional. Loaded into the operating memory 14 is an edge 

15 detection software application or module 18 that is designed to detect edges in multiple 
bit digital images using fuzzy reasoning in accordance with a preferred embodiment of 
the present invention. The computer system 10 can be implemented using any 
conventional PC, for example, but other computer systems can be employed as well. 
[0025] Multiple pixel digital images to be analyzed for edges are either retrieved 

20 from the storage memory 16 or from an external image source 20 and are fed into the 
edge detection application 18 for analysis with an edge detection algorithm. In the 
specific method of the present invention, a multiple pixel digital image is analyzed for 
edges on a pixel-by-pixel basis. That is, each pixel in the image is analyzed to 
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determine the degree to which the pixel likely represents a part of an edge in the image. 
The analysis relies on the fact that if a pixel is on an edge, then that edge will extend in 
some direction away from the pixel and pixels on either side of the edge will likely have 
gray values that differ substantially from one another. For example, if predominantly 
5 dark, low valued pixels are on one side of the edge, predominantly light or high valued 
pixels will likely be on the opposite side of the edge. 

[0026] With the foregoing in mind and with reference to the flowchart of FIG. 2, 
the algorithm of the present invention begins edge analysis of a pixel in the image at 
step 100 by identifying an edge path running through the pixel and calculating a pixel 

10 intensity gradient on either side of the edge path. To do this, a square n x n pixel 
window (n being an odd number greater or equal to 3) is used with the pixel to be 
analyzed being located at the center of the window. FIG. 3 illustrates such a 3 x 3 pixel 
window W with a plurality of pixels P and a center pixel CP. The n x n pixels P are 
arbitrary labeled (i, j) where i is the window's row number (i=0,1 ,2,„n-1) and j is the 

15 window's column number (j=0,1 ,2„„n-1 ). Since n is an odd number, the center pixel CP 
is located at x, y coordinates i = (n-1)/2 and j = (n-1 )/2. 

[0027] It should be noted that the use of the window W means that some pixels 
along the borders of the image will not be analyzed since they cannot be surrounded by 
a window. However, this is of little consequence since the outside edges of the image 
20 are not typically of interest in an edge detection analysis. For example, a 3x3 window 
would leave a 1 -pixel image margin without edge grade evaluation while a 5x5 window 
would generate a 2-pixel margin. 
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[0028] As also illustrated in FIG. 3, there are four possible edge paths EP through 
the center pixel: horizontal, vertical and two 45 degree diagonals. Each one of these 
edge paths splits the n x n pixel window W into two regions, each holding an equal 
number of pixels. In the preferred embodiment, the average change or gradient of gray 

5 levels across each one of the four edge paths is then computed and the edge path with 
the greatest change of gray levels S ma x is chosen to be used as a dimensionless input 
to a fuzzy membership function. If an 8 bit gray scale is employed a gray gradient value 
between 0 and 255 is generated; Smax will be a dimensionless number between 0 and 1 
as it is generated by dividing the gray gradient value by 255, the highest possible gray 

10 gradient value. It should be noted that while it is preferred to compare the intensity 
gradients of all four possible edge paths, any lesser number of the paths could be 
analyzed if desired, though this would likely diminish the accuracy of the edge detection 
process. 

[0029] The next step 1 02 of the process is called fuzzification. This step involves 
15 entry of S max into a fuzzy membership function as illustrated in FIG. 4, which shows the 
input membership function for a plurality of input linguistic values or characteristics that 
are associated with the dimensionless gray level gradient value, Smax- In the preferred 
embodiment, the input linguistic values (or labels) used for the average change of gray 
levels are those one heuristically might use: Small, Medium and Large. Thus, the graph 
20 of FIG. 4 shows the pixel gradient change S ma x as a function of the degree, from 0.0 to 
1.0, that the magnitude of Smax is characterized as Small, Medium and Large. The 
membership function therefore converts the single input into three input values, one for 
each label. 
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[0030] The next step 104 implemented by the edge detection algorithm is 
referred to as rule evaluation in which each of the input values generated by the input 
membership function is applied to an output membership function. FIG. 5 illustrates the 
output membership function in which inference rules are applied to the values obtained 

5 from the input membership function. The output variable u e is the degree of edginess 
that the central pixel in the window has based on the intensity gradient value and is 
preferably evaluated using a known inference method referred to as the Truth Value 
Flow Inference (TVFI) method that use singletons. Other more computation intensive 
inference methods, such as the well-known Mandani inference method, can be used, 

10 but the TVFI method is preferred for its simplicity that leads to a much less CPU 
demanding approach. The linguistic variables (or labels) of the output value are also 
those one heuristically might use: Edge, Mild Edge and No Edge. Simple inference 
rules are then used to express the dependency between the input and output values. 
Every input value goes through the rules to lead to its respective output value 

15 holding three weight values for each one of the output adjectives (Edge, Mild Edge and 
No Edge). It should be noted that the sum of these weight values does not have to 
equal 1.0 as fuzzy reasoning is not the same as probability. 
[0031] The inference rules are as follows: 

[0032] 1 ) If the grayness change is Small, then the central pixel is No Edge; 
20 [0033] 2) if the grayness change is Medium, then the central pixel is Mild Edge; 
and, 

[0034] 3) if the grayness change is Large, then the central pixel is Edge. 
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[0035] Thus, for each pixel, the inference rules will result in three characteristic 
output values, each between 0.0 and 1 .0, that represent the degree to which the pixel is 
No Edge, Mild Edge and Edge, respectively. 

[0036] The graph of FIG. 6 illustrates the application of the inference rules on 

5 both the input and output membership functions that yield the final set of truncated 
singleton values. In the example of FIG. 6, the input value 0.2 leads to input adjective 
weight values of 0.25, 0.35, and 0.8 for Large, Medium and Small respectively; these 
adjective weight values and the set of rules yield the truncated output singleton values 
0.25, 0.35, and 0.8 for the adjectives Edge, Mild and No Edge respectively. 

10 [0037] Once the truncated singleton values have been determined, the final step 
106 of the method is defuzzification where the three characteristic output values for the 
selected edge path are combined using an averaging union of singletons (TVFI method) 
or a centroid averaging (Mandini method) to determine a crisp output value for the 
central pixel. More particularly, the defuzzification process takes the union of the 

is truncated singleton values illustrated in FIG. 6, and then takes their weighted average to 
generate a crisp output value of 0.71 as shown in FIG. 7. In contrast with the Mandini 
method, the TVFI method does not need to determine the centroid of the resultant fuzzy 
set. The final output value of the central pixel is generated by multiplying the full 
grayness level (255 for 8-bit gray-scaled images) and its respective edginess degree (a 

20 number between 0.0 and 1 .0). This results in assignment of a new gray level value to 
the pixel that is directly proportional to the pixels' edginess degree. The algorithm then 
queries at step 1 1 0 whether all pixel windows have been evaluated. If not, the 
algorithm selects the next pixel at step 1 10 and returns to step 100 to repeat the 
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foregoing process until each pixel in the image has been characterized based on its 
degree of edginess. Once all pixels have been characterized, the application is done at 
step 112. 

[0038] To test the effectiveness of the subject edge detection technique, the 
5 image of a compact disc (CD) shown in FIG. 8 was used as input and analyzed using 
two prior art, mathematical based edge detection algorithms and the algorithm of the 
subject invention. FIGs. 9 and 10 show edge detection results generated by the prior 
art algorithms, known as Sobel and Prewit, respectively, while FIG. 1 1 shows the edge 
detection generated by the fuzzy reasoning algorithm of the subject invention. As the 
10 images show, the edge detection performance based on fuzzy reasoning widely 
supersedes those based on the prior art mathematical algorithms. For example, tiny 
edges are not detected by the prior art algorithms. There is a dark spot with tiny edges 
close to the center of the CD, and the fuzzy reasoning based algorithm of the subject 
invention clearly both detects and identifies it, while the prior art techniques fail to even 
15 detect it. Numbers and marks on the CD are also much clearer using the subject fuzzy 
reasoning edge detector. 

[0039] Although the invention has been disclosed in terms of a preferred 
embodiment, and variations thereon, it will be understood that numerous other 
modifications and variations could be made thereto without departing from the scope of 
20 the invention as set forth in the following claims. 
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